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22 Plain English summary 

23 This document outlines a proposal for a standardised way of describing the 

24 'who', 'how' and 'what' of initiatives such as research, education interventions, 

25 policy and international development. It will create a way to share 

26 Standardised Data on Initiatives - or STARDIT for short. 

27 STARDIT is a proposed way of developing terminology to report 'interventions', 

28 'research', 'projects' and other similar words that describe any kind of 

29 'initiative' or action, standardising data about initiatives and reporting impacts 

30 in multiple human languages. 

31 STARDIT is designed to create a standard way to share information about who 

32 was involved in an initiative (who did which tasks), what was done, what was 

33 learned and any impacts which occurred. It is designed to be useful across all 

34 disciplines, including health, environment, basic science, policy and 

35 international development. STARDIT reports will be shared open access (in the 

36 public domain), using machine readable linked-data. 

37 STARDIT also provides a way for initiatives to share ongoing updates to create 

38 'living' reports throughout the lifetime of an initiative (for example, at the 

39 planning stage, the doing stage and the evaluation stage). Data is structured to 

40 facilitate machine translation. In this way STARDIT will help contribute to 

41 creating novel metrics for future research, across languages. 

42 

43 Data will be shared in a way which will allow the creation of "living-systematic 

44 reviews" which could compare initiatives, including impacts and methods of 

45 involvement - allowing future involvement in research to be more evidence- 

46 informed. 

47 

48 STARDIT is being co-created in a collaborative way, with anyone in the world 

49 invited to be a part of shaping the development. All information about it will 

50 be shared for free under a Creative Commons licence. 

51 

52 The project is currently being hosted by the WikiJournals on Wikimedia 

53 Foundation servers. The co-creation process is being supported pro-bono by 

54 the charity 'Science for All' and has received in kind support from the EPPI- 

55 Centre. 



56 Abstract 

57 [in progress] 



58 Introduction 

59 Background 

60 The United Nations (UN) Universal Declaration of Human Rights states that everyone has the right to 

61 'receive and impart information' 1 . The UN also states that 'democracy, development and respect for 

62 all human rights and fundamental freedoms are interdependent and mutually reinforcing' 2 . To 

63 uphold human rights and for 'the maintenance of peace', people require 'media freedom' in order to 

64 'seek, receive and impart information' 2 . 

65 Never has it been more important to support people to be able to be involved in accessing, creating, 

66 and appraising information about reality, in order to make informed, fact-based decisions 3 . The 

67 scientific method is the best model humanity currently has to understand reality, sometimes by 

68 observing the effects of interventions (things we have done). In some contexts we call this research, 

69 in other contexts it is 'international development', 'education' or an 'initiative'. Hereafter all of the 

70 above will be referred to as an 'initiative'. 

71 Organisations like Cochrane and the Campbell Collaboration have been working for decades to 

72 create trusted ways of understanding medical, social and economic interventions, but there is much 

73 more to be done both in these disciplines and many others in order to create an evidence base for 

74 informing initiatives. 

75 Where we do initiatives (including choosing what gets researched) and where we do not do them 

76 has enormous implications for what humanity can know 4 . Those with different interests or stakes 

77 (stakeholders) may have financial or other interests, and may have perverse incentives to shape 

78 future initiatives in ways which compete or conflict with complex concepts such as 'public interest' 5 . 

79 For example, a systematic review found that industry funded research is more likely to have 

80 outcomes favouring the sponcor 6 . Similarly, the well-documented influence of the tobacco industry 

81 on the research agenda is a relatively simple example of a complex and profound problem with how 

82 human knowledge is created and shared by those with 'power' 4 . 

83 Ensuring people affected by initiatives are involved in shaping how they are done is essential to 

84 ensure that what is being done (including what is being researched) is aligned with the priorities of 

85 those affected 7 . This includes ensuring that access to knowledge generated from the initiative is 

86 universal (open access), according to the UN convention of Human Rights 1 . 

87 Meanwhile, 'citizen science' and participatory action research are blurring the lines between 

88 concepts such as 'researcher', 'public', 'patient' and 'citizen' 8,9 . For example, those doing the 

89 initiative and those affected by it may be the same people. The importance of involving people in 

90 initiatives by sharing power is clear 10 , but evidence-informed methods of doing this are lacking 8 . 

91 In addition, many of the problems facing humanity, such as air pollution, are not limited to distinct 

92 disciplines such as 'public health', 'environment' or 'education'. The approach to solving these 

93 problems requires complex and holistic 'systems thinking' 11 . Concepts such as national borders and 

94 'intellectual property' may begin to increasingly compete or conflict with solutions to problems such 

95 as pandemics and air pollution 3 . This in turn requires a form of reporting data from initiatives that is 

96 consistent across disciplines, including how people were involved in research. 

97 Governments, charities, research organisations, publishers, indigenous peoples, industry around the 

98 world are increasingly required to work in partnership with other global citizens to solve problems 

99 and create opportunities. For example, the future of genomic research and genomic initiatives is 
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challenging how we collect analyse and share 'big data' 12 , with these decisions potentially affecting 
all life on earth. Creating an evidence base to inform the most effective ways of sharing power when 
designing, doing and evaluating initiatives is essential in order to ensure efficient, effective and 
equitable ways of working 8 . 

This paper proposes a model for the continued improvement and refinement of the processes, 
language and taxonomies associated with involving people in planning initiatives, doing them and 
then reporting who was involved in which tasks and how. It is a task-based approach, promoting the 
use of the scientific method where possible. 

STARDIT is being created in partnership with a number of experts and organisations, including the 
Wikimedia Foundation, a global leader in both refining and improving multi-lingual and international 
ways of sharing knowledge. Other partners include researchers from La Trobe University, the not- 
for-profit organisation 'Science for All' and [insert other partners], 

STARDIT is intended to provide a helpful working model for comparison 8 , with any linguistic terms 
co-created by those involved and mapped to a universal taxonomy of linked-data, facilitating both 
machine translation and automated integration into future living-systematic reviews. 

Objective 

To create a working version of a data-sharing platform that will provide a number of solutions to 
address the problems of inconsistency in sharing data about initiatives (including all kinds of 
research) and who has been involved in the initiative and how. This framework is intended to 
support a culture of partnership working across disciplines (in science, publishing, government, 
education and international development). Where possible STARDIT has been designed to align with 
existing models and frameworks which are specific to certain areas and disciplines. 

Potential impacts and outcomes 

Novel metrics will be co-created using both qualitative and quantitative outcome measures. This will 
be made available in the public domain, and can be used for assessing impacts of both the initiatives 
themselves and impacts from involving different stakeholders in that initiative. This would increase 
the evidence-base and support informed decision making when planning involvement in initiatives. 

STARDIT will be developed in partnership with anyone who would like to be involved, and will 
initially be adopted by the Wikimedia Foundations open-access peer reviewed journals. If it is 
adopted by a 'critical mass' of other publishers, research funders and governments, it could create a 
novel 'prestige' within research and development communities to use the reporting framework. 

Over time, if successful, publishers and research funders could then move to a model which requires 
all initiatives to use this framework, allowing those accessing research to appraise public domain 
records of who was involved in which aspects of the research; how people were involved; how was 
data shared and any impacts from the research. 

Definitions 

This reporting framework takes a participatory action research paradigm to all actions - making the 
linguistic separation between 'intervention', 'research', 'project', 'initiative' and other similar terms 
less important than 'aims of specified action', 'outcomes from specific action' and 'who did which 
tasks or actions'. 


140 In this way, the framework becomes helpful for reporting any kind of intervention, project or 

141 initiative. For example, while it may be a helpful framework for reporting basic lab research or a 

142 clinical study, it may be just as useful for reporting an educational intervention in a community. 

143 This paper will use the word 'initiative' to describe any intervention, research or planned project. 

144 Examples include a: 

145 • Research project - any organised activity undertaken to answer a question. This includes 

146 data collection and analysis to help answer future questions which may arise. Projects may 

147 be nested within one another - the report context should clarify this 

148 • Project or initiative - any organised activity undertaken with planned outputs or outcomes. 

149 • Educational intervention - any organised activity designed to improve people's knowledge, 

150 understanding or skills 13,14 

151 

152 The concept of "involvement" in is defined as when research, initiatives or interventions are carried 

153 out "with" people rather than "on" them 15 . Involvement can also be defined as when power is 

154 shared, in order to allow the public, citizens, communities, patients or research participants to 

155 actively contribute to the process of research, an initiative, intervention or policy development 16 . 

156 Involvement is also distinct from engagement, which is when information and knowledge about is 

157 shared with the public 17 . 

158 

159 Defining concepts in universal taxonomy 

160 The terms used in this paper are working terms, and will be standardised as far as possible as this 

161 project continues. These terms will then be mapped to a universal taxonomy. One proposed method 

162 for doing this is to work within the unified semantic framework established by the Wikimedia 

163 Foundation's Wikidata initiative. This initiative includes standardised definitions, relationships 

164 between concepts and translations. Using this will allow translation from and to other languages (for 

165 example, a numerical code describes certain colours in the spectrum which can then be translated 

166 into multiple languages). 

167 Those involved in developing this framework can then work to group certain concepts and code 

168 them, aligned as far as possible with existing taxonomies, such as the National Library of Medicine's 

169 Medical Subject Headings 18 . For example terms like 'research participant', 'patient' and 'principal 

170 investigator' have clear and easily defined descriptions which are assigned codes in order to aid 

171 machine translation. This will be an ongoing process and may require creating a tool which allows for 

172 an evolving taxonomy. For example, the Wikidata entry for 'patient' defines it as a 'person who takes 

173 a medical treatment or is subject of a case study' 19 . The entry is assigned a code and has been 

174 automatically translated into 54 other languages. Similarly, the Wikidata entry for 'phase 1 clinical 

175 trial' indicates that it is performed on 20-100 healthy people, in order to determine 'safety and 

176 dosage' but not efficacy 20 . 

177 STARDIT development phases 

178 In order to be effective, it is essential that STARDIT involves as many people as possible. This section 

179 describes the development process so far, and the planned next stages and governance. Figure X 

180 summarises this process. 
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Figure X: STARDIT development 


Alpha version development 

• Reporting framework co-designed with a small team of experts 

• Pre-print published and working framework created in 
WikiJournals 


Ml 


Beta version development 

• Invite and analyse global feedback on Alpha version 

• Submit beta version for peer-reveiw 

M 


Version one implementation 

• Formally invite other journals to adopt the framework 

• Establish working group to continually improve the framework 

• Create a living systematic review 


Alpha version development method 

• This pre-print was created with a small team of experts from a number of different 
disciplines, informed by their work with diverse communities around the world. 

• The initial alpha version was informed by a number of frameworks and models (see 
supplementary materials 'Models which inform the standardised reporting framework') 

• Draft versions were shared with co-authors and final decisions were made using an online 
decision making platform, hosted pro-bono by the not-for-profit organisation 'Science for 
AH', working in partnership with the Wikimedia Journals. 

• This process was used to create this pre-print, and a working alpha version in the 
WikiJournals. 

• The team co-created a method to invite feedback and improvement from as many people as 
possible in the proposed beta development. 

Proposed Beta version development 

• Co-create method for involving people in developing STARDIT, informed by EQUATOR 
method for developing reporting guidelines and other relevant guidelines. 

• Invite public feedback on pre-print. A link to the paper and the feedback form will be shared 
widely in the public domain and via networks. 

• Decisions will be made using an online decision making platform, hosted pro-bono by the 
not-for-profit organisation 'Science for All' 21 , working in partnership with the Wikimedia 
Journals. 

• Submit beta version for peer-review in appropriate journals 

Version one implementation 

• Formally invite other journals to adopt the framework 

• Establish working group to continually improve the framework in order to align with as many 
international models as possible, including taxonomy development 
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It is proposed the working group will be co-hosted by the not-for-profit organisation 'Science 
for AH', although co-designing a tender process may be necessary for future versions. 




Logo 

A logo will be required for STARDIT in order for it to be recognised, including one which does not 
contain letters. The proposed logos are below. Figure 1 is the proposed full STARDIT logo, figure 2 is 
the proposed icon.Logos 

Figure 1: Full logo 



Figure 2: Icon 



Creating evidence with living systematic reviews 

A number of reviews have called for standardised ways of reporting involvement in research over 
extended periods of time in order to improve evidence-informed ways of involving people, and to 
understand 'works, for whom, why, and in what circumstances' 8 ' 10 ' 22 . Living systematic reviews of 
STARDIT reports could create a useful evidence-base for informing future best-practice. The stages 
would involve: 

• Forming a team scope the feasibility of creating a living systematic review based on the data 
from the reports (including exploring funding and partnership working) 

• Work in partnership with relevant stakeholders to ensure it informs international best- 
practice 

Scope and applications of STARDIT 

STARDIT is the first data sharing platform to provide a standardised way of reporting how people are 
involved in any initiative, across any discipline, including a framework for involving people in co¬ 
designing the initiative. 

This section addresses the current proposed scope and applications of the framework. 

Table X summarises the current limitations of existing reporting frameworks and models, showing 
the proposed solutions the STARDIT model offers. 


235 Table X: Summary of solutions to current limitations 
Limitations of current models and frameworks 

There are numerous models and reporting frameworks, which change according to 
the research discipline - making it difficult for governments and international 
organisations to assess impacts from interventions and creating challenges and for 
global change research 23 . 

The principles of involvement in research and other interventions are the same across 
all fields (health, environmental, basic, community based participatory, education), 
yet a significant number of models and frameworks are specific to health research. 

For example, existing models such as GRIPP2 are only appropriate for certain kinds of 
health and social care research 24 . In addition, a recent systematic review concluded 
the GRIPP checklist has not been widely adopted within the health and social care 
literature as yet and that journals do not require authors to report in that format 25 . 

Recent international consensus statements have clearly defined a role for the public 
in research which is 'data intensive', a kind of research which will continue to grow in 
importance 26 . While such statements call for both an assessment of impact and an 
evaluation of the process, numerous studies call for the creation of a standardised 
framework to report involvement in this kind of research 27,28 . 

Most other models and frameworks require research authors to know about them 
and adopt that framework 


Solutions to current limitations proposed by this framework 

This framework creates a standardised way for reporting interventions that 
is consistent across all disciplines of research. 

This framework does not attempt to replace any other model or framework, 
but to 'sit above' them, complimenting and incorporating other frameworks 
when required. 

Journals can adopt the online reporting framework and research funders can 
require completion. 


Those reporting on initiatives are encouraged to adopt the reporting 
framework when submitting papers for publication (by trialling the 
framework with publishers and research funders). The framework is 
intended to create new metrics for research impact, which over time, will 
create an incentive for researchers to report involvement and impact. While 
initial motivation for reporting may be intrinsic, as more partner 
oragnisations (such as research funders) adopt the framework, the may be 
formal requirements to report, or a form of prestige associated with being 
able to report impacts. 




Some models and frameworks are behind paywalls 29 , or remain 'intellectual 
property'- and are not in the public domain to allow adaptation or continuous 
improvement. 

The linguistic variation between terms such as 'involvement', 'engagement' and 
'participation' makes objective comparisons of interventions difficult. Concepts do not 
always easily translate to other languages, despite many research projects being 
multi-lingual in scope and impact. 


Time delays mean that evaluating the impact of research after the project is difficult 
to achieve and difficult to disseminate 29 . A number of reviews have called for 
standardised ways of reporting involvement in research over extended periods of 
time in order to improve evidence-informed ways of involving people, and to 
understand 'works, for whom, why, and in what circumstances' 8 - 10 ' 22 


There is a potential power imbalance and bias in only having certain stakeholders 
write up research and assess the impacts (for example, only researchers, not research 
participants or research users). 


The model will be licensed under Creative Commons - with the quality of 
any future iterations being the responsibility of not-for-profit host 
organisations. 

The framework will use an 'action-based' approach to the spectrum of 
involvement 30 - requiring clearly described 'tasks', negating a need for fixed 
definitions of concepts such as 'involvement', 'engagement' and 
'participation'. Where possible, terms and concepts will be mapped to a 
taxonomy which will allow translation between languages. The participatory 
model of the project means that anyone will be able to get involved in co¬ 
designing and co-defining terms use in the framework. 

The reports are 'living' and can be updated over time, allowing impact from 
research projects to be captured after the project has completed. 

The reports will be hosted by the WikiJournal of Science and quality-control 
(checking citations) will be carried out by the Editors. 

The reports will create an evidence-base for future living systematic reviews 
to analyse involvement and allow evidence informed involvement. 

The reporting framework will be led by the authors of the research, and will 
encourage the inclusion of multiple stakeholders in order to define outcome 
measures, identify indicators and collect and interpret data 23 . It will also 
provide an opportunity for people involved in the project to be authors of 
the STARDIT report. 


There is often an unhelpful or unnecessary divide between labels like 'researcher', The framework treats all with parity, encouraging self-identification to labels 

'participant', 'patient' and 'the public' which are likely to become increasingly blurred which people feel are most appropriate. Anyone can be listed as carrying out 
- for example, in future citizen science projects and public health genomics 31 . any task, regardless of their label. 
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237 Mapping preferences for involvement 

238 Involving multiple stakeholders in designing how people are involved in initiatives is considered best 

239 practice and may facilitate involvement 8 . Figure X is a mock-up of the STARDIT Preference Mapping 

240 (STARDIT-PM) which uses the STARDIT reporting framework as a tool to map the views and 

241 perspectives of potential stakeholders about involvement. 

242 It requires individuals to self-identify as belonging to a specific group of people (groups with specific 

243 co-created definitions), and share views about how other groups of people could be involved, or 

244 who should not be involved. For example, groups could include: 

245 • Only people with a professional role in the initiative 

246 • Everyone (any member of the public who is interested) 

247 • Anyone who might be indirectly affected by the initiative 

248 • Only people who are directly affected by the initiative 

249 • Only people who are participating in the initiative 

250 • Only people with a financial interest in the initiative 

251 It may be necessary to co-create further groups and sub-groups. 

252 By using a consistent tool across all initiatives, it allows a comparison of the views of different 

253 stakeholders, exploring similarities and variation about preferences for involvement. 

254 This approach creates a workable and consistent way for future projects to explore views and 

255 perspectives of stakeholders in initiatives (for example, a research project). When used alongside 

256 other planning tools, it can be used to help plan initiatives according to the preferences of 

257 stakeholders. 

258 Analysis of this data should involve a range of different stakeholders. 

259 The questions for mapping preferences are summarised below in Table X. 

260 Table X: Questions for mapping preferences for involvement 

Question Rationale for question 

Which stakeholder group does this person To establish which group the person identifies as being 
align with? part of - for example 'researcher' or 'participant' 

Describe any financial relationship or other To provide a public record of any potential conflicting or 
interest this person has to this project competing financial interest 

Views on who should be involved (which To establish that person's views on which 'groups' of 

'groups' of people) - including who should people they think should be 'involved' in research - that is, 

not be involved having a role in shaping the research design, direction and 

outcomes 

Views on specific tasks of this person or To establish that person's views on the tasks of the people 
group who they think should be involved. Note: Answers may 

require sub-categories if there are multiple categories for 
who should be involved (see Figure X 

Preferred modes of communication To establish that person's preferences on communication 

modes 





Views on what methods should be used To establish that person's views on which methods should 

be used to involve people - for example 'online survey' 


Views on facilitators of involvement 


Views on barriers of involvement 


Views on what the outcome or output of 
the involvement could be 


To explore that person's perceptions of what might 
facilitate involving specified groups of people and help 
inform the design of involvement 
To explore that person's perceptions of what might be a 
barrier to involving specified groups of people and help 
inform the design of involvement 
To ascertain the expectations of that person about what 
involving the specified groups of people might achieve 


Views on which stage of the research this To establish that person's views on which stage of the 
group should be involved? research the specified groups of people should be involved 



262 Figure X: Mock-up of the STARDIT Preference Mapping (STARDIT-PM) 
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Which 

stakeholder 
group does 
this person 
align with? 

Describe any 
financial relationship 
or other interest this 
person has to this 
project 

Views on who 

should be involved 

Views on specific 
tasks of this person 
or group 

Views on modes of 

communication 

Views on 

what 

methods 

should be 

used 

Views on 

facilitators of 

involvement 

Views on 

barriers of 

involvement 

Views on what 

the outcome or 
output of the 
involvement 

could be 

Views on 
which stage 
of the 

research this 
group should 
be involved? 

Researcher? 

Employed by 
institution co¬ 
ordinating the 
research study 

Hand-picked 
representatives from 
participants 

Reviewing informed 
consent documents 

Email, face to face 

One-off 

meeting 

Budget 

Institutional 

resistance 
(people are 
against 
involvement) 

Improved 

recruitment 

Recruitment 

Researchers 

All other aspects of 
research 

Teleconferences 

Informal 

meetings 

Quiet working 
space 

Limited time 

Aligned with 
grant application 
requiring 
involvement 

All 

Participants 

Expenses paid by 
institution co- 
ordinatingthe 
research study 

Elected 

representatives 

Over-see data 

access 

Face to face, email 

Formal 

committee 

with terms 
of 

reference 

Culturally 

appropriate 

language 

Not having a 
mix of face to 

face and 

telecoms 

Improved ethical 
access to data 

All stages 

General public 

Overseeing ethics 

Social media 

Survey 

Improved ethics 
governance 
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Standardised Reporting of Dissemination, Involvement and 
Translation - Alpha Version 0.7 

The data fields in the platform are summarised in the following tables. Table X is the full version of 
the data fields. Table X is the Minimum Contribution Reporting Form (MICRO), which is shorter 
version of this that contains the minimum information required to make a report. 

Technical details 

This report can be filled out as a simple online form. Some categories will have prescribed answers 
which will be machine-readable as XML data. 

While there must be named people accountable for the data in the reporting framework, 
completion can be led anyone associated with the initiative, including employees, researchers, 
participants or people affected by the initiative and other stakeholders. As many people as 
practicable should be involved in completing the report, including defining outcome measures, 
identifying indicators and collecting and interpret data 23 

• Once this report is completed it generates a version number of the report, which will be 
archived in the public domain (including Internet Archive) creating an immutable version. It 
is all updatable. Any future updates will be reviewed/approved by editors (for quality 
control) and when approved will generate new version numbers. 

• This will allow ongoing updates about the research project, including information about 
involvement, dissemination and translation over time, co-creating new metrics for 
'impact' 32 . 

• A short version of this reporting framework is the 'Minimum Contribution Reporting Form' 
(MICRO) which is the minimum information required to make a report. These fields are 
coloured blue. 
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295 Table X: Standardised Reporting of Dissemination, Involvement and Translation - Alpha 

296 Version XX 

297 


Section 

Data category 

Data field 

Initiative context - 
This information 
locates the 
initiative within a 
clear context. 

Identifying information 

Initiative name 

Geographic location or scope 

Purpose of the initiative 

Organisations or other initiatives involved 

Funding sources 

Clinical trial registration details (if applicable) 

Other relevant information (free text) 

Relevant URLs/URIs* 

Link: Description: 

Other relevant information (free text) 

RAiD (API) 

Stage or state of initiative 

At which stage of the research project has this 
report been written? (Select from: 

1. Before the intervention or initiative- this 
report is prospective or describes planned 
activity 

2. Ongoing - the intervention or initiative is 
still taking place 

3. After the research project or initiative has 
occurred 

Methods of the initiative (what is planned to be 
done, or is being reported as done) 

Report authorship - 

Information about 
who completed the 
report and how 

Identifying information 
for each author (authors 
can be anonymised in the 
public report but 
identities will need to be 

sent to WikiJournal 

Editors to attempt to 
prevent falsified reports) 

Name 

Public domain profiles, institutional pages 

Open Researcher and Contributor ID (orcid.org) 

Tasks in report completion 

Other information 

Accountability 

Key contact at initiative for confirming report 
content 

Involvement in 

initiative 

Who is involved in this 

initiative and how? 

Editors assessing 
involvement may need 
to use the STARDIT 

'Indicators of 

involvement' tool 

Details about how each 
group or individual was 
involved in the initiative 

Who was involved (select from groups or submit 
new group name in free-text) 

Specific tasks of this person or group (list as many 
as possible) 

How were these people involved (what methods 
were used) 

Facilitators of involvement (what do you expect 
will help these people get involved - or what 
helped them get involved) 































Barriers of involvement (what do you expect will 
inhibit these people from getting involved - or 
what inhibited them from getting involved). Are 
there any known equity issues which may 
contribute? 

Outcomes and outputs 

What was the outcome or output of the 
involvement of these people? What changed as a 
result of involving people? 

Stage 

Which stage of the initiative were these people 
involved? (select from list of pre-defined stages or 
allow 'other') 

Cost and time 

What was the estimated financial cost for involving 
people. How much time did it take. Were there any 
costs that cannot be measured financially? 

Learning points 

What worked well, what could have been 
improved? Was anything learned from the process 
of involving these people? 

Mapping financial or 
other 'interests' 

Financial or other 

interests 

Describe any financial relationship or other interest 
this person has to this project 

Describe any conflicting or competing interests 

Research data 

Hosting and storage 

Who is the data from this intervention shared 

with? 

How is it stored and hosted? 

Analysis 

Who is analysing the data? 

What methods will be used to analyse the data 

Dissemination 

How is information about this data disseminated? 

Ownership and control 

Who 'owns' the data 

Who controls access to the data 

FAIR criteria 33 

How is/will the data be 'Findable, Accessible, 
Interoperable, Reusable' according to the FAIR 
criteria? 

Research impacts 

What was learned 

What new knowledge has been generated? 

Knowledge translation 

Describe how the learning or knowledge generated 
from this initiative has or will be used 

Measurement 

How has or how will this be measured? 

Who is involved in measuring this? 

Indicators 

completed by Editors 
and/or peer reviewers 

Editors and peer 
reviewers assessing 
the report will need to 
look for indicators in 
the following 
categories 

Indicators of involvement 

Use the STARDIT 

'Indicators of 

involvement' tool 


Indicators of FAIR 


Indicators of translation 
and impact 



298 *The links will be automatically added to the Internet Archive upon submission of the form to 

299 future-proof reports from broken links 


























300 Table X: STARDIT- Minimum Contribution Reporting Form (MICRO) 


Section 

Data category 

Data field 

Initiative context - 
This information 
locates the 
initiative within a 
clear context. 

Identifying information 

Initiative name 

Geographic location or scope 

Purpose of the initiative 

Organisations or other initiatives involved 

Funding sources 

Stage or state of initiative 

At which stage of the research project has this 
report been written? (Select from: 

1. Before the intervention or initiative— 
this report is prospective or describes 
planned activity 

2. Ongoing -the intervention or 
initiative is still taking place 

3. After the research project or initiative 
has occurred 

Methods of the initiative (what is planned to 
be done, or is being reported as done) 

Report authorship - 

Information about 
who completed the 
report and how 

Identifying information for 
each author 

Name 

Public domain profiles, institutional pages 

Open Researcher and Contributor ID 
(orcid.org) 

Accountability 

Key contact at initiative for confirming report 
content 

Involvement in 

initiative 

Who is involved in this 

initiative and how? 

Editors assessing 
involvement may need 
to use the STARDIT 

'Indicators of 

involvement' tool 

Details about how each 
group or individual was 
involved in the initiative 

Who was involved (select from groups or 
submit new group name in free-text) 

Specific tasks of this person or group (list as 
many as possible) 

Outcomes and outputs 

What was the outcome or output of the 
involvement of these people? 

Mapping financial or 
other 'interests' 

Financial or other interests 

Describe any financial relationship or other 
interest this person has to this project 

Describe any conflicting or competing 
interests 

Research data 

Hosting and storage 

Who is the data from this intervention shared 

with? 

How is it stored and hosted? 

Dissemination 

How is information about this data 

disseminated? 

FAIR criteria 33 

How is/will the data be 'Findable, Accessible, 
Interoperable, Reusable' according to the FAIR 
criteria? 

Research impacts 

Knowledge translation 

Describe how the learning or knowledge 
generated from this initiative has or will be 
used (including from involving stakeholders) 


301 


























302 Discussion 

303 Implementation will need to involve multiple stakeholders, with any useful living-systematic review 

304 likely to be at least 5 years away. This paper proposes a starting point only. Decisions about how this 

305 project is run, governed and makes decisions will be decided transparently using public online 

306 discussion forums, and public events where possible. The data-sharing platform has been designed 

307 to be both interoperable with existing standards, and future proofed to allow continuous 

308 improvement. 

309 Case studies 

310 The STARDIT data-sharing platform has been designed to align with case study methodology. It 

311 allows for having multiple authors in a report, as multiple people involved in this way can bring 

312 different ways of analysing and interpreting data 34 - 35 . Similarly, having multiple perspectives involved 

313 may aid understanding any causal relationships by comparing (triangulating) data from different 

314 people, enhancing the reliability of the analysis 26 -STARDIT provides a way of consistently sharing and 

315 comparing data while using the case study method. 

316 Limitations 

317 In addition to the many problems facing humans, are those facing non-human animals and eco- 

318 systems. With systems like rivers now being assigned 'personhood' 36 ' 37 , post-colonial environmental 

319 and social sciences have attempted to challenge and redefine traditional and colonial-era concepts 

320 of what can be 'owned' as property 5 . In order for research and other interventions to operate in an 

321 inclusive, culturally neutral way it is necessary to lead a reconsideration of the language to describe 

322 the relationship between humans and the environment at a personal, national and international 

323 level 5 . For example, a public consultation by the 'dominant' people or cultures in a society might ask 

324 'who owns the rights to a water in a river system?' 38 . This might presume the dominant people's 

325 values of 'owning' a natural resource are universally accepted by all of the public they wish to 

326 consult, thus imposing their values on people who might not share the concept of 'ownership'. For 

327 example, Western European legal and economic traditions might be incompatible with those of 

328 some indigenous peoples' 5,39 ' 40 . 

329 By working in partnership from the start of the process, the STARDIT project is an attempt to map 

330 this process and provide both guidance for planning and evaluating involvement in initiatives. 

331 However it will be an ongoing and complicated process to 'de-colonialise' language and a challenge 

332 to some people's cultural attitudes which may not align with the universally enshrined principles of 

333 democracy, human rights and environmental rights. 

334 This paper proposes a model to meet the need for the continued improvement and refinement of 

335 the processes, language and taxonomies associated with involving people in planning initiatives and 

336 reporting how they were involved 23 . It must continually appraise how inclusive the multi-lingual, 

337 multi-discipline international model is. The Wikimedia Foundation is a global leader in both refining 

338 and improving multi-lingual and international ways of working and this project hopes to continue to 

339 work in partnership with 'Science for All' and other organisations to improve these ways of working. 


340 



341 Supplementary materials 



342 

343 Mock up of completed Alpha version 0.7 

344 Research project context 


Identifying information 

Research 

project 

name 

Geographic 

location 

Purpose of 
the project 

Organisations or 
initiatives 

involved 

Funding 

sources 

Clinical trial 
registration 
details (if 
applicable) 

Relevant URLs/URIs 

Fictional 

Biobank 

UK 



Government 


Link 

Description 

https://www.fictionalbiobank.ac.uk/ 

Main website 

Other relevant information (free text) 

This report was co-produced by Chief investigators and participant representatives 


345 


At which stage of the research project has this report been written? 


Ongoing - the research project is still taking place 



346 


Who completed the report 

Names 

Identifying information (public domain 
profiles, institutional pages) 

Open Researcher and 

Contributor ID (orcid.org) 

Jo Bloggs 

University.edu/jobloggs 

3333333 

John Doe 

Research participant 


Anonymous 

Research participant 



347 


























348 Who is involved in this initiative and how? 


Who 

Specific 
tasks of this 

person or 
group (list 
as many as 
possible) 

Modes of 

communication 

How were 

people 

involved 

(what 

methods 

were used) 

Facilitators of 

involvement 

Barriers of 

involvement 

What was 

the 

outcome or 

output of 
the 

involvement 

Which stage 
of the 

research 

were these 

people 

involved? 

Cost 

and 

time 

Learning 

points 

Describe any 
financial 
relationship or 
other interest 
this person has 
to this project 

Describe 

any 

conflicting 

or 

competing 

interests 

Data 

scientists 

analysis 

Email 

Meetings, 

webinars, 

conferences 

Caffeine 

Australian 

internet 

speeds 

Correlation 

of DNA 

sequences 

and disease 

risk 

Data analysis 

400 

hours 

at 

$100 

an 

hour 

It took more 

time than 
expected to 
plan involving 
the public 

employee 

Attended 

conferences 
paid for by 
industry 

Members 

of the 
public 

Improving 
ethics and 

governance, 
overseeing 
data access 

Face to face, 
email, group 
video calls 

public 

events, 

information 

shared 

online, 

formal 

working 

groups 

1. Paying travel & 

accommodation 

2. Involving 
potential 
participants in 
the design of 

the 

involvement 

plan 

Limited 
budget to 
pay people 
for time 

Improved 
ethics and 

governance 
framework, 
acceptable 
data access 
policy 

aligned with 
perceived 
public 
interest 

Every stage 

10 

hours 
at $0 

an 

hour. 

Travel 

and 

hotel 

$200 

Online 

facilitated 

discussions 

were the 

most efficient 
way to 

communicate 

Paid for travel, 
accommodation 

Part of 
advocacy 
organisation 
funded by 
pharma 


349 Research data 


Who is the data from this initiative shared with? 

How is it hosted? 

How is information about this data disseminated? 

Research institutes which meet ethical criteria 

Secure servers 

Public events, press releases, social media, conferences 

Who is analysing the data? 

People from research institutes which meet ethical criteria 

What methods will be used to analyse the data 

Specialised programme (link to open source code here) 

Who 'owns' the data 

UK Government on behalf of the UK public 

Who controls access to the data 

Data Access committee 

How is/will the data be 'Findable, Accessible, 

Interoperable, Reusable' according to the FAIR criteria? 

Link to report here 


350 
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352 Research impacts 

What new knowledge has been generated? 

Improved understanding of genomic variations which may affect disease risk 

Describe how the learning or knowledge generated from this initiative has or will be used 

Improved diagnosis for people with rare diseases caused by genomic variations of known significance 

How has or how will this be measured? 

Reported clinical outcomes 

Who is involved in measuring this? 

National Health Service England 

353 




354 STARDIT - working proof of concept 

355 A working version of the reporting framework can be used at this address: 

356 https://en.wikiversity.Org/wiki/Template:STARDIT draft 

357 



358 STARDIT 'Indicators of involvement' report review tool 

359 For Editors or peer-reviewers reviewing the STARDIT report, it may be necessary to look for objective 

360 indicators in the public domain in order to verify reports in categories such as involvement and 

361 research data. This section provides a proposed method to transparently review and label 

362 involvement. 

363 Background to involvement indicators 

364 Concepts such as 'involvement', 'ethics' and 'democracy' cannot always be expressed fully in 

365 linguistic constructs, as they carry resonances of concepts such as equality, justice and human rights 

366 41 . A number of systematic and scoping reviews have attempted to map such concepts 8,42-44 . 

367 These indicators are an attempt to reduce subjectivity in describing 'involvement' by articulating in a 

368 standarsised way what objective measures might exist which would suggest that 'involvement' 

369 (power sharing) is occurring, and for what purpose 45,46 . The indicators can be grouped and 

370 categorised in the table below and yet all of them rely on a foundational assumption or axiom - 

371 which is that those affected by interventions or research are the people most appropriate to design 

372 and deliver it - recognising all skills and knowledge have equal value 4S . The 'UK Standards for Public 

373 Involvement in Research' define indicators of involvement as 'a statement of good practice that 

374 describes what is needed to demonstrate meeting the standard' 47 . STARDIT aligns with this 

375 terminology, extending 'indicators' beyond public statements in order to incorporate other 

376 indicators, for example, governance documents or reported actions. 

377 There may be intrinsic or extrinsic reasons for involving people 48 . For example, the purpose or 

378 'driver' of involving people might be to include personal experiences in order to improve the 

379 research 49 , to abide by regulation or law, or to do it because there is evidence which indicates 

380 involving people will improve the research 50(p356) . a narrative review identified three broad value 

381 systems associated with involving people 51 , which included values based on: 

382 • ethical, human rights, equality, openness and accountability 

383 • evidence based, objective assessments of effectiveness and consequences of involvement 

384 

385 For the purposes of this reporting framework, these have been categorised below as four broad 

386 'purposes'of involvement. 

387 

388 

389 


390 



391 Diagram of the purposes of involvement and measurable indicators 


392 

393 

394 

395 

396 


Purpose of involvement 

Obliged: There are legal or other codified power 
constructs in place which oblige involvement in 
initiatives and research 

Post-positivist: lived (subjective) experience and 
knowledge is valued equally alongside other kinds 
of knowledge 

Evidence-informed: There is evidence which 
suggests that involving people improves the quality 
and direction of initiatives and research 

Self-evident: The concepts of ethics, human rights 
and democracy demand involvement — 


Measurable indicators 

• Legal or government documents 

• Public statements about 
involvement 

• Policy 

• Support for people to get involved 
s "“ • Reported actions 

• Peer reviewed papers 

• Governance documents 

• Evidence of funding for 
involvement 


Foundational principle 

Those affected by initiatives are the people most appropriate to help design, deliver and evaluate it 


397 









398 

399 

400 

401 

402 

403 

404 

405 

406 

407 

408 

409 

410 


Models and papers which inform the standardised reporting framework 

The reporting framework is informed by multiple models and reporting frameworks, will be 
compatible with many of them and future-proofed to allow further development in the articulation 
of reporting. 

Table X summarises the frameworks and models which informed this work and how. 

The search strategy is summarised in the figure 'STARDIT models and framework search strategy'. 
[Please note, a systematic search strategy will be created with authors of the pre-print and inserted 
here]. 

In order to inform future iterations, the authors suggest that future versions of STARDIT are informed 
by regular systematic search, review and appraisal, with the protocol published in PRISMA. 

Figure X: STARDIT models and framework search strategy 














411 Table X: Models and frameworks which inform the standardised reporting framework 

412 [The final version will be organised alphabetically] 


Name 

Status 

Access 

Year 

Field 

Aspects which informed STARDIT 

GRIPP2 52 

Peer-reviewed 

Open access 

2017 

Health research 

Terminology, ways of reporting involvement and 
impact, mapping preferences for involvement 

National Standards for Public 

Involvement in Research 47 

Not peer- 

reviewed 

Public 

domain 

website 

2018 

Health research 

General terminology, indicators of involvement 
(including impact) 

7Ps Model 53 

Peer-reviewed 

Paywall 

access 

2012 

Health research and 
policy 

General terminology, taxonomy for stages of 
research adapted from this model 

PCORI 54 

Not peer- 
reviewed 

Public 

domain 

website 

2018 

Healthcare research 

Informed general terminology within the word 
'stakeholder' 

Center for Comparative 
Effectiveness Research in Cancer 

Genomics 55 

Peer-reviewed 

Paywall 

access 

2012 

Cancer Genomics 

Informed general terminology and terminology 
specific to genomics research, as well as methods 
of assessing impact of involving stakeholders. 

Cochrane Knowledge Translation 
Strategy 56 

Not peer- 

reviewed 

Public 

domain 

website 

2017 

Health research 
evidence, knowledge 
translation 

General terminology, including 'audiences' and 
ways of assessing knowledge translation 

Tugwell 6Ps 57 

Peer-reviewed 

Open access 

2006 

Health research 
evidence, knowledge 
translation 

General terminology, ways of assessing facilitators 
and barriers (including 'community' involvement), 
ways of involving people in co-designing research 

CRediT taxonmv 58 

Not peer- 

reviewed 

Public 

domain 

website 

2017 

Biology 

Informed taxonomy to define author 
contributions to primary research papers 

PRISMA for systematic reviews 59 

Peer-reviewed 

Open access 

2009 

Systematic Reviews 

General terminology, including stages of 
systematic reviews 

CONSORT for randomised 

controlled trials 60 

Peer-reviewed 

Open access 

2010 

Randomised controlled 

trials 

General terminology, including stages of trials, 
outcome reporting and other categories. 





















Public Involvement Impact 
Assessment Framework 61 

Not peer- 

reviewed 

Public 

domain 

website 

2014 

Health research 

General terminology, mapping values and 
preferences associated with involvement, 
assessing impacts of involvement 

Shippee 62 

Peer-reviewed 

Open access 

2013 

Biomedical and health 

services research 

General terminology, description of research 
stages, informed search strategies 

Fazey 23 

Peer-reviewed 

Paywall 

access 

2014 

Interdisciplinary and 
multi-stakeholder 

research 

Informed terminology regarding knowledge 
exchange in interdisciplinary and multi¬ 
stakeholder research 

Reed 29 

Peer-reviewed 

Open access 

2018 

Evaluating involvement 
in interdisciplinary 
research 

Informed general terminology, informed ways of 
evaluating involvement in research and other data 
collection 

EQUATOR guidelines 63 

Not peer- 
reviewed 

Public 

domain 

website 

2019 

Health research 

Informed general terminology, informed design of 
reporting 'explicit methodology', STARDIT 
designed to work with all EQUATOR guidelines. 

EQUATOR method for developing 
reporting guidelines 64 

Peer-reviewed 

Open access 

2010 

Health research 

Informed general terminology, informed the 
design of the process for co-creating STARDIT 

Australian Research Council - 
Engagement and Impact 
Assessment 65 

Not peer- 

reviewed 

Public 

domain 

website 

2018 

Research (multi¬ 
disciplinary)* 

Informed general terminology, including assessing 
involvement and impact 

The Value+ Toolkit 66 (European 
Patients' forum) 

Not peer- 

reviewed 

Public 

domain 

website 

2013 

Health research and 

services 

Informed general terminology, informed 
definitions of involvement and indicators of 

involvement and barriers to involvement. STARDIT 
designed to align with Value+ Toolkit 

Research Activity Identifier (RAiD) 

67 

Not peer- 

reviewed 

Public 

domain 

website 

2018 

Research (multi¬ 
disciplinary) 

STARDIT designed to be interoperable with RAiD 

Patient Focused Medicines 
Development (PFMD) 'Book of 
Good Practices' 68 

Not peer- 

reviewed 

Public 

domain 

website 

2018 

Medicines research 

Informed general terminology, terminology 
around shared 'purpose' and data collection fields 
- in particular the 'Patient Engagement Quality 
























Guidance Tool' ('Planning a project' and 'Assessing 
an ongoing or completed project') 

International Committee of 

Medical Journal Editors (defining 
the role of authors and 
contributors) 69 

Not peer- 
reviewed 

Public 

domain 

website 

2019 

Medical journal 
publication 

Informed terminology defining 'authorship', 
including authors of STARDIT reports 

BMJ guidelines for reporting 
patient and public involvement in 
research 70 

Not peer- 
reviewed 

Public 

domain 

website 

2019 

Medical research 

Informed minimum reporting requirements for 
STARDIT, informed 'cost' and 'time' reporting 

Supporting the Use of Research 
Evidence (SURE) 71 

Not peer- 
reviewed 

Public 

domain 

website 

2011 

Evidence-informed 

policy 

Informed terminology to describe evidence- 
informed policy, informed terminology to describe 
stakeholders 

FAIR Guiding Principles for 
scientific data management and 
stewardship 33 

Peer-reviewed 

Open access 

2016 

Scholarly data (multi¬ 
disciplinary) 

Alignment with categories for reporting on 
principles for scientific data 

ACTIVE framework to describe 

stakeholder involvement in 
systematic reviews 72 

Peer-reviewed 

Paywall 

access 

2019 

Systematic reviews in 

health research 

Informed terminology around defining 
stakeholders and ways of defining involvement 

Open Toolkit for Tracking Open 
Science Partnership 

Implementation and Impact 73 

Awaiting-peer 
review (as of July 
2019) 

Open access 

2019 

Science (multi¬ 
disciplinary) 

Informed terminology and data collection fields 

European Patients Academy on 
Therapeutic Innovation (EUPATI) 
Guidelines on Patient 

Involvement in Research and 
Development 74 

Peer-reviewed 

Open access 

2018 

Medicine research and 
development 

Informed general terminology, including stages 
aligned to guidelines 

PPI Ready: Researcher Planning 
Canvas 75 

Peer-reviewed 

Open access 

2019 

Basic and preclinical 
health research 

Informed general terminology, including impact 
and values 

Nunn 8 

Peer-reviewed 

Open access 

2019 

Public health genomics 

Informed general terminology, informed task- 
based reporting categories. 




















Pollock 76 

Peer-reviewed 

Open access 

2018 

Systematic reviews in 

health research 

Informed general terminology, informed design of 
STARDIT creation process 

PROGRESS-Plus 77 

Multiple peer- 
reviewed papers 
cited 

Public 

domain 

website 

2017 

Systematic reviews in 
health research 

Informed 'Other information' in describing 
authors categories and 'barriers' (describing 
potential equity issues for who was involved) 

Social Determinants of Health 
(World Health Organisation) 78 

Published book 
(WHO) 

Open access 

2003 

International public 
health 

Informed 'Other information' in describing 
authors categories and 'barriers' (describing 
potential equity issues for who was involved) 

NIHR Public Involvement Impact 
Working Group 79 

Not peer- 

reviewed 

Public 

domain 

website 

2019 

Health research 

Informed definitions of impact 

Guidance on 

co-producing a research project 
(INVOLVE) 80 

Not peer- 

reviewed 

Public 

domain 

website 

2018 

Health and social 

research 

Informed general terminology, how people can be 
involved in stages of research 

Tackling Representativeness: A 
Roadmap and Rubric 81 

Not peer- 

reviewed 

Public 

domain 

website 

2018 

Health care 

Informed terminology around representation 

The book of good practices in 
Patient Engagement 82 

Not peer- 

reviewed 

Public 

domain 

website 

2018 

Medicine development 

Informed general terminology, including defining 
stakeholders and stages of medicine development 

Patient Engagement Quality 
Guidance 83 

Not peer- 

reviewed 

Public 

domain 

website 

2018 

Medicine development 

Informed general terminology, including assessing 
involvement in the stages of medicine 
development 

The Value of Engagement (PCORI) 

84 

Not peer- 
reviewed 

Public 

domain 

website 

2018 

Health care 

Informed general terminology, concepts of 
'engagement' and 'involvement' and partnerships 
and evidence informed involvement 

Carman 85 

Peer-reviewed 

Open access 

2013 

Health care, population 
health 

Informed general terminology, including different 
descriptions of involvement and enabling 
conditions that support it 




Dissemination and 

Implementation Toolkit (PCORI) 86 

Not peer- 

reviewed 

Public 

domain 

website 

2017 

Health care 

Informed terminology and assessment of 
involvement at the stages of dissemination and 
implementation 

Patient engagement (Canadian 
Institutes of Health Research) 87 

Not peer- 

reviewed 

Public 

domain 

website 

2017 

Health research 

Informed general terminology around involving 
people in health research 

Dubois 88 

Peer-reviewed 

Open access 

2013 

Medicine comparative 
effectiveness research 

Informed terminology around involving people in 
assessing evidence adoption 

Bloom 89 

Peer-reviewed 

Open access 

2018 

Clinical Trials 

Informed language to describe partnerships 
between different stakeholder groups (industry, 
academia, patients and public) 

Public Involvement (Health 

Research Authority) 17 

Not peer- 

reviewed 

Public 

domain 

website 

2019 

Health research 

Informed general terminology, including 
distinctions between involvement and 

engagement 

Domecq 90 

Peer-reviewed 

Open access 

2014 

Healthcare research 

Informed general terminology, informed search 
strategy 

Nilsen 91 

Peer-reviewed 

Open access 

2006 

Health care 

Informed general terminology, informed search 
strategy 

Brett 10 ’ 22 

Peer-reviewed 

Open access 

2014 

Health and social care 

research 

Informed general terminology, methods of 
assessing impact and informed search strategy 

Dukhani 27 

Peer-reviewed 

Open access 

2018 

Health care 

Informed general terminology, search strategy, 
articulating outcome measures 


413 

414 *This impact assessment has been piloted with the following kinds of research; Chemical Sciences, Medical and Health Sciences, History and Archaeology, 

415 and Philosophy and Religious Studies, Environmental Sciences, Agricultural and Veterinary Sciences, Engineering, Education, Studies in Creative Arts and 

416 Writing, Language Communication and Culture, and Indigenous research. 65 
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